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CHAPTER  1 
IHTBODUCTION 


dravbacic,  and  despite 


terminology  ia  still  widely  accepted  there 
which  the  straightforward  systematization  !■ 
not.  The  problem  with  a systenacisation  in 
categorical  independent 
along  which  the  distlnctione 


with  respect  to  each  other.  Relating  a dependent  variable 
to  schedule  parameter  as  the  independent  variable  gives  ts 
an  •empirical  law'  that  is  valid  only  with  respect  to  a 
particular  schedule  type.  If  we  manipulate  the  type  of 
schedulef  the  differences  in  the  independent  variables  can 
only  be  described  qualitatively.  Bmpirieal  laws  that  "cut 

syatematiaatlon  ie  baaed  solely  on  categorical  independent 
variables. 

the  poBitlon  that  he  had  adopted  by  the  1950s  suggested  a 
way  out  of  the  dilaamia.  in  Science  and  Human  Bahavior 
(Skinner,  1953;  p 105}  he  wrote  that  schedules  are  "simply 
rsther  inaccurate  ways  of  reinforcing  rates  of  reeponding' 
and  in  schedules  of  Seinforcsment  (perater  t Skinner,  1957) 


the  moment  of  reinforcement  a given  set 
1 usually  prevail.  A schedule  ie  simply 
ay  of  arranging  th 


auch  stimuli,  and 


f the  organism  is  in  part  controlled  by  them 
or  by  similar  atimull  according  to  a well  established 
prlnclpie  of  operant  ellaorinination  (p.  3). 

common  kinds  of  variables  end  a systematisation  in  terma  of 
them  should  cut  across  schedule  type.  Although  Skinner's 
diacuBsion  is  consistent  with  'molecularism' — the  view  that 
the  effects  of  schedulee  can  be  understood  in  teims  of 
differentiation  of  response  classes  and/or  discrimination 


accepted  the  possibility  that  rate  of  reinforcement  was  an 
operative  variable,  i.e.,  a 'molar'  view  (Farster  ( Skinner, 
19S7,  p.  400).  Skinner's  position  seems,  thus,  to  have  been 
the  basis  of  three  movements;  molecularism,  molarism  and  an 
approach  to  which  they  are  subordinate.  This  last, 
superordlnata,  approach  will  be  referred  to  as  the 
oontrolling-variabie  approach,  after  teller  (1977). 

Following  Skinner'B  lead,  Seiler  (1977)  outlined  what  he 
believed  had  been  the  overall  strategy  of  reinforcement- 
schedule  research.  Schedules,  ha  argued,  are  ccmposed  of 

that  exist  solely  because  of  the  axperimanter  ’ a 
arrangements.  Examples  are  maximum  rate  of  teinforceraent 

reinforces  under  ratio  schedules.  Notice  that  direct 
variables  are,  in  feet,  what  would  usually  be  called 


independent  veriailes.  Indirect  varlablee,  on  the  other 
hand,  are  variables  that  are  not  given  solely  by  the 

organlsiB.  Rate  of  reinforcaoent  under  a ratio  schedule  is 
an  example  of  an  Indirect  varlabie.  These  are  variables 
that  are  said  to  "control*  behavior  but  they  are  not 
independent  of  behavior.  Deecribing  this  approach,  zeiler 
(19H4,  p,  4B9)  vrltest  "Instead  of  being  created  ae 
i=^i^evible  cauaee  of  behavior,  schedules  are  conaidered  as 
complex  independent  variablee  that  bring  into  play  a set  of 
Bore  basic  controlling  conditions."  notice  that  Zeller’s 


confusing;  it  is  possible  for  schedules  to  bs  "complex 
independent  variables"  but  schedules  are  not  cosposed  of 
independent  varlablee  according  to  the  controlling-variable 
approach!  variables  that  ara  Indirect  under  a particular 
schedule  simply  cannot  be  independent  variables  with  respact 
to  those  same  scheduies.  The  controlling-variable  approach 
is  not,  however,  ailent  on  the  issue  of  Independent 
variables;  one  way  to  Inveatigate  the  effects  of  indirect 
vexiables  is  to  arrsnge  conditions  under  which  they  are 
^ifdct  (independent)  variables,  with  the  variable  under  Che 
experimanter'a  control,  the  eetabllahnent  of  the  function 
relating  behavior  to 
empirical  matter.  T 


straightforward 


direct  one  vUl  likely  change  perfomanoe,  but  it  will  not 
neeeeearily  tell  o.  hoe,  or  even  it,  that  variable  exerte 


1. )  dXl/dt»£(Xl,  X2,  X3,  X4), 

2. )  dX2/dt=f(Xl), 


3. )  cU3/dt-f[Xl),  and 

4. )  dX4/dt=f(Xl) 

This  Bysnan  rsprsBsnta,  in  the  a 
be  true  of  behavior  as  a syatem. 
particular  variables  depend  on  t 


Bl  of  other  variables. 


response,  X2  is  rata  of  reinforceoieat,  X3  is  the  number  of 
responsea  per  relnfcrcer  and  X4  is  mean  reinforced 
interresponse  time.  Notice  that  aquations  2 throuQh  4 
depend  on  the  experimenter's  arrangement.  Eguatlon  2,  for 
example,  must  be  a constant  under  a ratio  schedule,  but  must 
be  some  nonotonic,  negatively  accelerated,  decreasing 
function  for  interval  schedules.  When  variables  X2  through 
X4  are  made  direct  (independent)  variables  by  changing  the 
schedule,  the  form  of  eguatlons  2-4  change.  Each  schedule, 
then,  would  have  its  own  unique  configuration  of  equations. 
What  we  want  to  Icnow  is  Equation  1 because  it  is  Che 
expression  describing  how  these  variables  Interact,  but, 
from  a strictly  empirical  etandpclnt,  all  chat  can  be  )cnown 
la  the  values  talcen  by  XI  through  tine  under  unique  sets  of 
conditions.  'The  main  point  here,  however,  is  not  that  the 
controlling-variable  approach  is  "wrong"  or  that  the 
research  conducted  in  the  experimental  analysis  of  behavior 
is  flawed.  The  main  point  is  that  the  approach  cannot  yield 
a quantitative  systematisation  through  directly  smpirlcal 


ijiplled — and  rightly  ao — by  the  controlling-variable 


aptually. 


3cace  Acnroaeh 


Tha  Pundmental 


to  event) 
currently 


(ISeiler,  1977),  Interlocking  (Perator  t Skinner,  1957)  tine- 


Withlji  the  space  as  well  aa  sone  achaflules  that  closely 
resenble  differential  ralaforoeeent  of  low  rate  (DHL) 


Uple  only 


1-.  and  are  DTE,  a,  and  BI,  raapectlvely.  The 

apace  la  divided  at  RTE-0  by  the  vertical  incerval-tlne 
plane.  Tima  achedulea  exiac  where  a-0  and  interval 


Figure  1.  Experimental  domain  o£  the  achedule  space. 
X-axlBt  response-time  exchange  value  fRTB);  Y-axisi 
'S'  parametecj  Z-axia:  Ease  interval  value  (fil). 


.tes  of  response  are  very  low. 


feedback  fenction  (Baun,  1973,  1989J  which  depicts  rate  of 
reinforceiaant  as  a function  of  sate  of  responding.  In  doing 
so  the  superiority  of  Che  molar  perspective  is  not  implied; 

descriptions;  a feedback  function  does  not  uniguely  identify 

interval  (FI)  schedules  would  have,  for  eaample,  the  same 
molar  feedback  function  as  mixed  or  tandem  FR  FI.  A mixed 

the  presence  of  the  same  stimulus  conditions  (Skinner, 

1957).  Figure  3 shows  some  feedback  functions  for  the 
portion  of  the  space  where  a — BI  is  held  constant  at 


simply  straight 


Figure  2.  Some  feedback  fcnctlone  from  wlthib  the 
expezLnental  domain.  X-axiei  reaponae  rate  in 
0.0D5  a unitai  Y-axiai  zeinfozcera  per  eecond.  The 
"a"  and  BI  parametera  were  held  conatant  {a=*  a, 

BI«  so  a)  while  RTS  waa  equal  to  0,  -1,  or  1 a. 


linea  of  poaitiva  elope  where  RTE  ia  negativer  and  of 
negative  elope  where  RTE  ie  poeitive.  The  feedhacX 
functiona  are  conatent  functione  when  RTB*0.  All  of  the 

X-l/|Blt(O.S/R)]-R(RTB]/BI, 


r-tl-R(RT8)]/BI. 

In  the  above  eguatlona,  rerate  of  reinforcement  and  R-rate 
of  reeponee.  The  firat  egnatlon  ylelde  a reaaonable,  but 
Bomawhat  overaioplified  deacription.  It  ie  baeed  on  the 
notion  that  the  eobedullng  of  reinforcere  in  the  ‘interval 
portion*  of  the  schedule  described  by  l/[BI+( .OS/R) ) is 

R and  not  what  ie  indicated  by  the  expreseion  (Baum,  1973). 


In  their  sesiinal  paper,  Schoenfeld,  Curating,  & Kearat 
(1956)  outlined  the  t-echedule  eyatem.  In  this  eyscem,  t 
temporal  intervals,  t^  and  t*,  alternated.  Typloally, 

d only  occur  for  the  first  response  in  t‘ 

e temporal  parameters  to  be  constant  within 


l$S9) . Either  t 


, was 


J random-ratio  {RR} 


reinforcement  cycle  enda.  A random-ratio  schedule  is  one  ii 

reinforcement.  Figure  3 (top  panel]  shows  feedback 
functions  associated  with  some  different  parameters  in  the 
t-achedule  system. 

except  there  were  two  temporal  intervals  whioh  were 
superordinate  to  t°  and  t‘.  That  is,  and  t‘  alternated^ 
and  within  each  of  these  intervals  t°  and  t*  alternated. 

Any  response  which  coincided  with  a t°  period  was 

other  stipulation  was  that  during  t",  the  duration  of  t” 
must  be  greater  than  in  t*.  Prom  its  inception  the  t-systes 
was  an  aobitloua  project,  its  progenitors  having  as  their 
goal  the  integration  of  ratio  and  interval  schedules  and 

Although  Schoenfald  at  al.  (1956)  based  their  integration  o 


a molecular  v. 


Intarlocklng  SchedulSB 


feedback  function  le,  in  contrast  to  conventional  interval 
schedules,  essentially  a constant  function  except  at  very 
low  response  cates.  It  should  be  recalled,  however,  that 

schedule  is  nearly  flat  over  a great  range  as  well  (see 
Figure  2).  These  schedules  are  included  here  with 
interlocking  schedules  because  they  are,  essentially, 
interlocking  echedulaa  with  the  interval  portion  being  of 
the  ’linear'  type  (also  called  ’Intervals  by  the  clock’). 

fundamental  schedule  space  relate  to  the  possibility  of  more 
than  one  ralnforoer  being  -set-up.’  This  necessitates  the 


e’  variable  whici 

(nesting  either  criteria  incranenta  the  store)  t)ie  result  is 
similar  to  traditional  interlocking  schedules  (RTB<0  and 
a — >infinity) . When  the  ’store"  is  decremented  )uy  a ratio 
contingency  but  incremented  by  the  interval  contingency,  the 
schedules  are  very  similar  to  those  in  the  schedule  space 
where  RTB>0  (responses  add  time  to  the  currently  scheduled 
interval)  with  a— >inflnity. 

The  Interactive  Schedule 

The  interactive  schedule  (berger,  1986)  is  based  on  the 
feedback  functions  for  ratio  and  interval  schedules.  Its 
exposition  will  proceed  as  in  Berger's  (1988)  paper.  The 


inetantangous  frequency  of  reinforcement,  i,  under  ratio 


reinforcec  and  R is  the  rat 
raaponeea/reinforcar.  The 
reinforcement  availahility 


Llo  value  having  the  dlmeneione 
under  interval  echedulee  is 


where  I is  the  interval  value  having  the  dimension  of 

combined 

f-(r/R)« 

Sotice  Chat  when  the  erponent,  x,  la  equal  to  rero,  the 
equation  becomes  equal  to  the  equation  for  minimum  time  per 
^einforcer  and  when  it  is  equal  to  one,  the  equation  becomee 
equal  to  the  equation  for  Instantaneous  rate  of 
reinforcement  in  ratio  echedulas.  Both  B and  i may,  in  the 
equation  above,  bo  replaced  by  a constant,  C,  which  has  the 
dimensions 

[(reeponses-)  (time'-*)  J/reinforoer. 

This  then  ylelde  the  equation 


This  la  equivalent  to  holding 
despite  their  different  units; 
responses/reinforcer  and  50  a. 
limited  to  values  between  0 an 


The  variable 


The  feedback  functions  generated 


splayed  in  Plgura  3 (bottom 


teoDB  of  feedback  functions.  Indeed,  his  description  was 
altered  in  order  to  plot  the  feedback  functions  displayed  in 

function  at  x-0,  given  by  Serger’e  equation,  is  a constant 
function  (i.e.,  the  feedback  function  for  a tiiae  schedule), 

however,  eliminated  by  adding  a tezm  to  C.  That  is, 
[0,5/(rate  of  response) I**". 

describes  1/t  as  ninimusi  time  per  reinforcer,  which  is 


rigorously,  he  would  have  been  led,  perhaps,  t. 


tine  schedules  and  Interval  schedules.  As  it  stands, 
Berger's  squation  is  nors  rslsvant  to  the  space  which 
includes  time  and  ratio,  but  not  interval,  schedules. 
Raehlln's  Anoroaoh 

Although  fZachlin  (1978)  waa  not  intereeted  in  creating 


empirical  feedback  functiona  could  lead  to  t)ie  creation  of 
been  that  if  one  variee  echedule  type  (VI,  VR,  VT),  the 


whexe  C is  the  tioe  spent  consuning  the  reinforcer,  I ie  the 
time  epent  responding,  m ie  an  exponent  which  changea  with 
acheduie  type,  and  a (unrelated  to  the  a parameter  of  the 

impliea  that  what  he  ie  presenting  could  be  used  to  create  a 
schedule.  He  writes  (p.  346],  'variation  of  a aingle 

n-0]  to  variable  interval  (0<m<1.0]  to  variable  ratio  (at 
D-1].'  given  the  overall  context  of  Kachlin'a  (1978)  paper. 
It  ie  llhely  that  what  he  meant  waa  chat  m ie  the  parameter 

could  arrange  a schedule  which  had  the  theoretical  feedback 
function  characteristics  associated  with  the  equation  given 
above,  one  could,  for  example,  utilise  the  method  of 
HcDoweli  and  Hixted  (1996)  whereby  feedback  functlone  are 
directly  arranged. 

A Conparieen  of  fha 
ScQue_and  Purpose 

f the  interlocking  schedule 
the  systems  suggest  a set  of  schedule 
ce  a classification  system — that  is  more 

e interval-ratio  continuum — at 


parameters — c 

and  schedule 
are  vitally  concerned 


least  as  a point  of  departure.  Hany  erl 
systen  tradition  were  trying,  at  least  t 
encompass  as  many  traditional  schedules 
(Schoenfeld,  Cumning  6 Haarst,  19S6) 
(1973)  later  tried  to  do» 


encompassing  traditional  schedules,  i 

easily  as  the  t-schedules,  encompass  ths  traditional 

focus  to  incorporating  more  behavioral  processes;  the 

contingent  on  "not  responding"  allowed  for  avoidance 
behavior  (Sidley,  1963)  to  be  produoed  as  well  as  for  the 
delivery  of  response-independent  events.  This  latter 
feature  waa  not  seen  as  merely  "adding  time  schedules"  to 
those  already  embraced  by  the  e 
the  t-t  system  could  encompass 

system  and  the  schedule-space  approach 
Although  Berger  (1968)  did  not  seem  to 
encompassing  system  in  mini 


B well  as  operant 


schedules,  ths 


n response-independent 


schedule-space  approach. 


9 negatively  accelerated  a 


Interlocking,  Interactive, 
rate  of  response  and 


t-v  schedules  were  typically 
aleo  Interested  In  dynamic 


ch  they  displayed  ~bteak-j 
the  data  of  relevance  to  i 
e been  collected  within  t] 

n these  experinencs  T wae  held  constant  while  T 

versa  (CusEnlng  s Schoenfeld,  1959;  Schoenfeld,  Gumming  and 
Hearse,  1956].  Schoenfeld,  Gumming,  and  Bearst  (1956],  for 


conetant  and  varied  T 

cumulative  recorde  re* 
decreased  as  well  as  < 

these  findings  and  elucidated  t 

Gumming  (I960]  summarised  the  findings  from  these  kl: 
experiments  In  the  form  of  response  rates  averaged  ai 


cm  l.DO  to  .013  (Experiment  2). 

la  that  response  rate  increased  as  T 
n T decreased,  subeeguent  direct 

» character  of  the  functions 
Schoenfeld  and 


ally  be  pic 


Responses/min 


(s) 


translation 


the  Interval  component  {or  in  a 

RTB>-I(Bl/initial  ratio  value).  The  RTB  value  for  a ratio 
aohedule  ia  -i[BI/(deaired  ratio  value-1) ).  Notice  that  the 
BI  value  for  a ratio  schedule  only  approaches  infinity — it 
can  always  be  assigned  some  value.  To  arrange  a ratio 

assign  BI  a very  large  value  such  that  reinforcement  would 
essentially  never  be  "set-up'  independent  of  behavior. 

Berryman  and  Nevin’s  (19S2)  experiment  provides  data 
which  allow  for  comparison  of  achedulea  that  differ  in  only 
one  parameter.  Soma  of  these  data  are,  however,  difficult 
to  interpret  since  Berryman  and  Nevin  did  not  provide  a 
description  of  variability.  The  following  description  of 

an  inverse  function  of  RTS  value  at  both  BI  values  (120  s 

true  only  at  BIe240  s.  For  2 of  these  3 subjects  {Rats  2 
and  4)  rate  of  response  was  a direct  function  of  RTS  at 


BI-120  e and  for  Che  third  (Rat  3)  rata  of  response  did  not 
change  as  a function  of  changes  in  RTB  at  Bl-120  s.  For  all 
4 subjects  rate  of  response  was  highest  under  FR  3S  but  for 
2 of  the  4 {Rats  1 and  2)  the  difference  in  rate  of  reeponse 


agll9lbl« 


suggest  that  rate  of  responas  was  essentially  the  sane 
except  for  Rat  4 whose  data  were  the  siOBt  disorderly  (see 


Responses/min 


aul..t*nt;ially 


allowed  by 


Responses/min 


fMdhack  functiORB  vare  Idantlcal  (axoept  at 
rates).  The  feedback  functions  were  not.  ho« 

rate  of  responding,  where  BI  was  soall  and 


Figure  7 shows  areraga  rata  of  response  as  a function 
of  BI  and  RTE  for  the  four  rats  in  the  Ettinger  et  al. 

(1987)  experioant.  Pointe  are  connected  if  they  are  fron 
the  Bame  aet  (agual  initial  ratios  and  thus  egui-elope)  or 
if  they  have  the  sane  RTB  value  (five  sets  of  trlplete).  As 

increases  in  BI  value,  response  rate  tended  Co  increase. 

Host  of  the  functions  from  egui-slope  schedules  depicted  in 
Figure  7 are  negatively  accelerated  or  s-ahaped.  ReBponsa 
rate  also  tended  Co  increase  Bolaly  as  a function  of 
changing  the  BI  value.  For  all  four  rats,  schedules  having 
an  initial  ratio  (IR)  value  of  16  produced  the  lowest  rates 
of  response  in  comparison  with  the  o< 


The  data  from  Powers  (19«8),  Rider  (1977),  and  Ettinger 
at  al,  (1987)  suggest  that  a diagonal  movement  through  the 
independent-variahle  space  [RTF  decreases  as  BI  IncreaBes] 


response  irrespective 


Figure  7.  Response  rate  as  a function  of  RTE  and  B1 
for  rats  in  Bttinger  et  al.  (1987).  The  'a~  paraiMter 
panel.  E-anea t RTB  value  in  seconds;  T'axest  responses 
per  ninute;  2-axes:  BI  value  in  seconds. 


Responses/Min 


Baum  {1993}  Sailed  to  maintain  raaponding  at  ratio  vaiuaa 
over  512 — lose  for  moat  of  the  plgeona . Thia  bitonic 
function  probably  characterisea  all  ]ciQdB  of  ratio  echedulee 
but  data  on  the  laeua  are  difficult  to  find.  Ratio 


value  minua  one  (once  ceeponeea  subtract  enough  time  off  of 
the  currently  scheduled  interval,  there  ie  still  one  loore 
reaponae  required,  at  least  when  one  is  arranging  ratio 
schedules  where  a— >tnflnity)  ie  than  given  by  -1(BI/RTB). 

There  have  also  been  a reasonable  number  of  studies 
examining  the  effects  of  time  echedulea  (i,e.,  aaO)  and 
comparing  them  with  the  affects  of  echedulea  of  responee 
dependent  reinforcers.  Typically,  time  schedules  maintain 
lower  rates  of  responding  than  response-dependent  schedules 
(l.e.,  a — >-),  and  responding  may  even  cease  altogether 
(Burgess  i Heardon,  19B1|  Catania  s Keller,  1981;  Lattal, 
1972,  1974;  Seiler,  1968).  It  is  probably  true  chat  FT 
schedules  do  not  produce  as  rapid  and  complete  a 
as  VT  schedules,  especially  when  compared  Co  fix 
variable  intervals  (Uttal,  1972).  Finally,  son 


characteristics  of  the  behavior  maintained  by  reeponse- 
Indapendent  echedulee  nay  depend  on  the  )clnd  of  response- 
dependent  schedules  to  which  the  subjects  have  been  exposed 
(Burgess  fi  Weardon,  1981). 


referred  to  here  as  the  a parameter  (except  at  the 
endpointe).  Lattal  (1974),  however,  investigated  the 


Ettingec  et  al.«  using  rats,  investigated  VI  values  of  30, 

Vaughn  (1962),  using  pigeons,  investigated  VI  values  o£  30, 
45,  and  60  (for  each  subject)  with  eithex  FR  20,  40,  or  60 

his  pigeons  to  linear  VI  schedules  whose  rate  of 

(See  Vaughn  6 Killer,  1964,  for  these  data).  With  the 
exception  of  the  matched  VI  schedules  In  the  Vaughn  (1962) 
study,  t)ia  manipulations  in  these  two  experiments  fall  along 

t)ie  RTB  value  was  increased.  The  translation  of  Vaughn's 
(1902)  schedule  terminology  into  BI  and  RTB  isi  BlaVI,  and 

functions  for  schedules  with  positive  RTB  values  are 
bitonic.  An  example  is  given  in  Figure  2.  Recall  that  the 

on  "linear"  interval  schedules  and  sc  the  function  is  not 
continuously  differentiable  at  the  maximum  as  it  is  in  Che 

transition  between  the  ascending  and  descending  limba  of  the 
function] . In  the  two  experiments  described  above,  equal  FR 

Comparing  data  from  within  a set  of  equi -slope 


schedules  (PR  subtraction  value 


respolue  tended  to  be  hlgheBt  where  BI  and  RTB  ware  saalleat 
and  lowest  where  BI  and  RTS  were  largest.  Figures  8 and  9 
show  response  rates  taken  £rOD  figures  in,  respectively, 
Bttlnger  et  al.  (1987)  and  Vaughn  and  Killer  (1984)  and 
plotted  in  terns  of  Bl  and  RTS.  The  left-  and  right-hand 
panels  of  each  pair  of  panels  in  Figure  8 shows  response 
rates  from  under,  respaotively,  schedules  with  FR 


subtraction-values  of  15  and  2 
right-hand  eolnmns  of  Figure  9 
respeotlvely,  schedules  with  F 


show  response  rates  from. 


The  soblecta  in  Bttlnger  et  al.'s  experiment  were 
exposed  to  more  than  one  set  of  egui-slope  schedules  and, 

was  no  consistent  relation  between  the  two  data  sets.  For 

in  the  two  sets,  and  for  the  renalnlng  two  subjects  there 
tended  to  be  a snail  difference  between  the  two  in  terms  of 
rate  of  response  but  in  opposite  directions.  In  the  Vaughn 
(1982)  study,  subjects  were  exposed  to  only  one  set  of  egui- 
slope  Bchedules  and  therefore  only  between-subject 

lowest  for  subjects  exposed  to  the  schedules  producing  the 
steepest  negative  slopes  (l.e.,  under  the  FR  20  subtraction 
value)  and  highast  under  schedules  producing  the  shallowest 
negative  slope  (i.e.,  under  the  FR  60  subtraction  value). 


Responses/min 


Responses/min 


B&lntaXned  undar  the  eabtrection  schedules  to  which  they 
were  Batched.  For  6 of  Che  9 subjects,  the  highest  rates  of 
response  were  prodooed  by  the  "richeBC"  linear  VI  schedules. 
These  coiDparlsons  are,  however,  somewhat  complicated  by  the 
fact  that  no  indications  of  variability  were  provided. 

Berger  (1988],  investigating  his  ‘interactive 

half  of  the  subjects  were  exposed  first  to  x«0.0  and  x was 


subeequently  increased  to  8.3,  0.7,  and  1.0.  (One  eobjeot 

linear  function  of  x but  aubjecta  differed  In  their 
sensitivity  to  this  variable.  For  all  of  the  subjects 

x-0.0.  Regression  llnss  fit  to  each  subject's  data  show 

condition  in  which  x was  increased  acrose  phases. 

It  has  been  suggested  Baum  (1973,  1989)  that  ratio 
schedules  maintain  higher  rates  than  interval  schedules 


becanse  the  correlation  between  rate  of  reaponae  and  rate  of 
relnforcaaent  id  greater  In  ratio  echadulea.  While  the 
firet  derivative  of  an  interval-achedule  feedback  function 
la  large  at  low  reaponae  ratea,  It  ia  negligible  at  higher 
ratea,  while  the  derivative  of  a ratio-echedule  feedback 
function  IB  a conatant  ituch  greater  than  zero  (-amch  greater 
than  zero"  relative  to  the  flrat  derivative  of  interval 
achedule  feedback  functione  at  all  but  very  low  cates  of 
reeponee).  This  view  is  typically  known  as  a -molar"  view 

responae  is  some  function  of  rate  of  relnforcejnent  (though 
the  former  etatement  empbaelaed  the  derivative  of  the 
feedback  function  rather  than  its  value).  The  "elope" 
explanation  of  interval-ratio  differences  cannot  be  applied 

characteriaee  the  data  from  most  of  the  t-tau  schedule 
experiments  and  from  Berger's  interactive  schedule 
experimentr  it  cannot  explain  why  reeponee  rates  should 
increase  after  the  implementation  of  schedules  which  result 
in  decreases  in  rate  of  reinforcement  as  well  as  no  change 
in  the  slope  of  the  feedback  function.  Thia  condition 
raanlts  whan  the  PR  component  of  an  Interlocking  echedule  is 

Powers  (1968),  Berryman  a Kevin  (1962),  and  Bttinger  at  al. 
(1987)  provided  data  relevant  to  this  iasue.  In  an  attempt 
ther  data  it  is  tempting  to  say  that 


o summarize  t 


f response  w 


h schedules 


having  £ee<iback 


a=hedule.-a.peclally  flxed-intarval  and  fixed-ratlo-were, 
and  still  ara,  generally  thought  to  produce  distinctive 


type 


: relntorcere  pi 


(p.  30) 


1>urT>o«a  ot  Bxnarlnaim 


developnent  of  thg  schedule-spaco  approach  {i.e., 


5baljiiity 


nding.  They 


typically 


ciiM  (IRT) 


CHAPTEB 


METHOD 


subjects  in  Esperlment  1 were  experlmentslly  naive  at  the 
beginning  of  the  esperinent  and  those  in  Experiment  2 had 


schedule 


point  on,  wete  tsaninaced  after  40  reinforcera. 
(BI=60  a,  RTE«0  8,  a*ln£lnity) 
the  axperiaent}  subjecte  i 
baseline  following  every  "experljBantal 

bacame  store  negative] . The  parametera 
the  feedback  function  asaociated  with  T 
interaacted  the  feedback  function 
a schedule  at  the  point  which  represented 


of  VI  60  a.  An  exajnple  of  this  relationship  ia  shown  in 
figure  ll,  which  depicts  feedback  functions  for  VI  £0  a and 
a •matched"  VR  schedule  (BI— >inflnlty  and  -1[RT8]  la  some 
fraction  of  BI  such  that  -l|BI/RTE]-the  ratio  value).  If  a 
pigeon  reaponded  at  an  average  of  x reaponaea/eec  (averaged 
over  the  final  10  aaeaiona]  under  the  baaellne  VI  60-s 
schedule,  any  parameter  (RTB  and  BI]  values  eatlafylng  the 
equality, 

n*l/(BI-f{.S/eo])-[(x<BTE)/BI],  could  constitute  the  values 
of  the  succeeding  experimental  phase.  Adherence  to  this 
procedure  insured  that  overall  race  of  reinforcement  and  the 


Plgura  11.  Paedbaok  functione 
'matohed'  raclo  aetiedule,  The 
the  ratio  schedule  Intersacts  t 
response  under  the  vx.  x-aslei 
(reinforoere  per  second}. 


faedhaok  function  for 


'£  reinforcement 


4 a from  tha  previous  RTE  value  (eee  Table  1).  Thus,  the 
first  reaponae  aubtraeted  2f  a from  the  currently  acheduled 


TABLE  1 , CONCITIOMS  ADD  HUKBER  OE 
SESSIONS  BACH  HAS  IN  EFFECT  FOR  EXPERIMENT  1 
50BJECT 


CONDZTIOH 


SUBJECT 


CONOITIOH 


SUBJECT 


Bchedule.  Soma  data  wara  mlaplaeed  during  one  o£  the  VI  60- 
B bseellne  echedule.  eo  it  ie  impoaalble  to  tell  axsetly  ho« 


Experiment  1,  were  VT  schedulee.  Also  unlUca  In  Experiment 
I,  aubjBcte  ware  not  returned  to  a particular  baseline 


alao  changed.  ThiB  chacactariBatiDn  applied  to  all  schedule 
changes  up  to  the  reinatateiBent  of  the  VT  aehedule  {RTSeQj. 
Table  2 lista  the  aeguence  of  conditions  to  which  each 


subject 


ocndition  was  in 


TABLE  2.  CONDITIONS  AND  NUKBER  0?  SESSIONS  EACE  HAS  IN 
EFFECT  FOR  EXPERIMENT  2 

SUBJECT 


CHAPTER 


RESULTS 


andex  the 
PigaoBB 


are  canitted  from  this  figure.  Specifically,  for  Pigeon 


Response  s/min 


VI  1st  ten  last 


1097 


5994 


2760 


Sessions 


Figure  13.  Percent  Vl  naximie  responee  r 
function  of  the  percent  VR  under  baseline 

for  explanation);  T-axie:  (reaponee 


VR  slope 


Responses/min 


PiguEe  15.  Rate  of  reaponss  as  a function  of  aeaaicna 
undsc  some  exparijrantal  phases  for  all  three  pigeons. 

3t-axesi  sessions;  T-axasi  responses  pec  ainute. 


Molecular  deierlptlon 

reapectivaly.  tha  3 rove  of  each  figure  diaplay,  from  top 
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obAbly  produced  by  oi 


(Top 


aesociated  with  eucceaelva  peaks  (left  to  right)  tended  to 


Figure  22.  Average  IHT  duration  aa  a function  of 
ordinal  poeition  poBt-reinforcement  during  the  last  3 
BBBsionB  under  a representative  experirkental  condition 
and  its  preceding  baseline  phase  for  Pigeon  1097.  The 
first  point  in  each  panel  is  the  average  latency  to  the 
indicated  at  the  top  of  each  column.  X-axes:  ordinal 
position  in  interreinforsement  interval:  T-axes:  IRT 


IRT  Duration  (0.01  s] 


1097 

VI  60  s VI  3000  s,  RTE  = 


Ordinal  Position 


ordinal  poeltlon  poet-relnforcanent  during  the  last  3 
and  Its  preceding  baseline  phase  for  Pigeon  5934.  The 

Indicated  at  the  top  of  each  column.  X^axes:  ordinal 
position  in  interreinforcenent  Intervali  T-axesi  IRT 


5994 


VI  60  s VI  600  s,  RTE=-8.5  s 


Ordinal  Position 


reinforcement. 


2760 


1st  of  last  3 sessions 


2nd  of  last  3 sessions 


2 


3rd  of  last  3 sessions 


Ordinal  Position 


anly  slightly 


IRT  Duration  (0.01  s) 


5994 

VI  60  s VI  600  s,  RTE=-8.5  s 


Ordinal  Position 


2760 


For  Pigeon 


Figure  2B.  IRT  duration  as  a function  of  ordinal 
poaltion  in  the  sesaion  during  the  laat  3 aeBaiona^^ 

preceding  baseline  phase  for  Pigeon  1091.  The 
condition  is  Indicated  at  the  top  of  each  column, 
r-axaai  ordinal  position  in  eeseion;  T-axesc  IRT 


1097 


figure  29.  IRT  duration  aa  a function  of  ordinal 

^Adltion  is  indicated  at  the  top  of  each  column. 
X-axeet  ordinal  position  in  seasion;  Y-axest  IRT 


5994 


VI  60  s VI  600  s,  RTE=-8.5  s 


Ordinal  Position 


“ • **i  ordinal  poaltion  in  aeasion;  T-a: 


2760 

VI  60  s 


Ordinal  Position 


1st 


2nd 


3rd 


unlikely  within  about  the  first  500  IRIS,  figure  30  offers 
some  evidence  that  Pigeon  2760  did,  in  fact,  exhibit  the 


the  left-hand  panels  a couple  of  featurea  are  apparent,  for 
Pigeon  1097,  all  wlthln-session  changea  aaaentially 


figure  caption. 
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Sessions 


Por  Plgaon  3673 


itablllzed  ai 


Subject  numbers  are  Indicated  In  each  pai^.  :(-axaai 
(Eesponsea/mln) ; Z-axesi  BI  value  in  seconds. 


Responses/min 


Figura  34.  IRT  dletributloM,  IHTS/OP,  and  the 
diatribucion  of  delaya  to  relnforcenent  for  the  laet 

dlatributiona  [top  panela)  are  expressed  as  relative 
frequencies  as  are  the  distributions  of  delays  [bottom 
panela).  The  IRT/OP  functlone  appear  in  the  middle 
[top  to^botton)  panele.  Subject  numbers  appear  above 

frequency  ox  IRT8/0P  [as  indicated  by  axes  labels.) 


1694  1404 


0.01  s bins 


tenporally  local  probability  of  reeponaa.  For  both  Pigeona 


peak  In  the  irt/op  function  but  not  neoaeaarily  the  hlgheat 
peak.  For  14D4  It  is  difficult  to  aee  from  the  IRI 
dlatributlon  that  a keypack  waa  very  unlikaly  at  about  0.8  a 


(Flgti 


(P19UI 


frequently  long  d 


IRT  Duration  (0.01 


VT  600  s,  RTE=-15  s 


Responses  or  Reinforcers 


1404 


For  Pigeons  1694  and  1404  long  IRT3  appeared  to  be  nearly 
eguiprobable  across  ordinal  poeition~at  least  judging  free 


only  may 


IRT  Duration  (0.01 


VT  600  s,  RTE=-15 


Ordinal  Position 


r Pigeon  3673  the  probability  of  long 


QvfMll  WBgrae  rateai  VI-VH  or  interlorklno 


position  io 


2.  7ho  subjQct  numbers  are  Indicated  at  the 
column.  K-axea:  ordinal  position  in 


IRT  Duration  (0.01  s) 


VT  600  s,  RTE=-15  s 


1694  1404  3673 


Ordinal  Position 


r Pigeon  2760  In  this  figure 


panel  of  Figure  15  begin.  For  1 


figure  39.  Overell  teeponee  rata  as  a function  of 
sessions  following  the  change  from  baseline  to 
experimental  phase  during  two  different  transitions 
Pigeons  1097  (top  panel)  and  9994  (bottom  panels), 
particular  experimental  phase  is  indicated  in  each 
panel.  Each  transition  followed  exposure  to  VI  so  a 
Sessions  for  which  data  were  lost  or  protocol 
compromised^e  not  shown,  and  aone  poi«s  are,  thus 


Responses/min 


(PlgnrB  39,  top  laft)  thara  was  a more  gradual  increata  tor 
a period  of  approxlnately  35  easaiona.  During  aubaeguant 
tranaitiona,  each  aa  the  ona  ehown  in  Figure  39  (top  right), 
rata  of  raaponee  typically  increaaad  rapidly  to  near  the 


Pigeon  5994  ahoaed  a rapid  increase  in  rata  of  reaponae 
in  one  tranaitlon  (Pigure  39,  bottom  laft)  but  only  after  a 
period  of  relative  ataaia  lasting  nearly  50  aeaaione.  At 
the  beginning  of  this  tranaitlon,  however,  there  was  a 
rather  rapid,  but  modest,  increase  in  rata  of  response  which 
preceded  the  period  of  ataaia.  in  this  aensa,  there  is 
actually  a strong  resemblance  between  the  two  left-hand 
panels  of  Pigure  39.  por  Pigeon  1097,  too,  there  was  a 
period  of  relative  staais.  It  la  clear  that  1097  did  not 
show  such  a dramatic  Increase  In  rate  of  response  following 

characterised  aa  -perlode  of  staais  followed  by  periods  of 
raaponaa-rate  increases.-  A similar  description  may  be 
suggested  for  Che  ateady-atate  osclllationaj  the  system  is 
nonstable  states . Seaplte  the 

question  Is,  -How 


introduced  in  the  Reeulta  sectioi 
descriptive  aspect  Co  it.  Here  t 

a punctuated  by  response 

response  as  dramatic 


e resembled 
, though^  1C 


Figure  39.  Ttis  pigeon's  other  transiilons  m 

steady.  Even  with  the  x-axls  eoraprsssed  in  tl 
there  appear  to  be  3 or  a periods  of  relative  stasis. 

For  Pigeon  2760  [Plgure  15)  changing  to  an  experimental 
phase  produced  a period  of  time  {about  SO  sessions)  during 
which  rate  of  response  increased  slowly.  This  was  then 
followed  by  a deollne  in  response  rata  to  baseline  levels. 
These  phases  ware,  unfortunately,  not  carried  on  long  enough 
to  say  if  rate  of  response  would  have 
levels  comparable  to  those  observed  a< 


after  the  phase-change.  It  could  Joe  argued  that  Pigeon 
2?60’b  data  reseoble  those  of  the  other  two  pigeons  in  terms 
hibernate  stasis  and  acceleration;  in  the  case  of  this 
pigeon  the  steady-state  performance  maintained  under  the  vi 
60-B  schedule  nay  be  an  unstable-state  under  interloclcina 
conditions,  indeed,  this  notion  is  implicit  in  including 
the  transition  in  with  the  steady-state  data  for  pigeon  3760 
in  Plgure  15.  For  the  other  two  pigeons  a transition  stats 
was  easily  identified,  in  retroepeot,  after  the  phase  was 
run  long  enough  to  ascertain  the  range  of  oscillations 
during  the  -steady-state.-  For  pigeon  2760,  than  range  of 
oscillation  Included  the  baseline  rates  of  response. 
Blmllarly,  for  Pigeon  5994,  the  very  large  increase  shown  in 
the  bottom  left-hsnd  panel  of  Plgure  39  is  also  shown  in  the 
middle  left-hand  panel  of  Figure  15  which  shows  steady-stete 
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Relative  Frequency 


1097 


0.01  s bins 


Plgura  11.  Relative  frequency  of  different  IRTS  for 
eelected  Beasione  followinq  the  change  from  baaalLne 
a repraeentative  experimental  phase  (VI  600  a.  RT&=~ 
a]  for  Pigeon  5994.  The  ordinal  position  of  the 
seaeion  la  given  in  each  panel.  R-axeai  0.01  a bins 
y-axeat  relative  frequency. 


5994 


Relative  Frequency 


2760 


0.1  s bins 


Seesion  26  [Plgura  41,  top  right)  IRT6  obviously 


rigure  43.  IHT  duration  aa  a function  of  ordinal 
poaition  in  tha  aaaaion  for  ealected  Beaaions  during 

exparimental  phaaa  {VX  3000  a,  RTE=-49.0  a)  for  Pigaon 
1097.  The  ordinal  poaitlon  of  tha  aaaaion  la  given  in 
each  panel,  x-axeat  ordinal  poaition  in  the  aeaaioni 


IRT  Duration  (0.01 


1097 


Ordinal  Position 


Pigura  44.  IRT  duration  as  a function  of  ordinal 
exporlrtantal  phase  [VI  6D0  a,  RTB*-8^5  s)  for  Pigeon 
T-axea:  IRT  duration  in  Q.Dl  s units. 


IRT  Duration  (0.01 


5994 


Ordinal  Position 


be  compared  to  thoae  In  Figures  29  and  29  which  show  this 
hind  of  analysis  for  the  stable-state  conditions  which 
precede  and  succeed  the  transition. 


also  be  observed  during  1 
probable  within  a sesaloi 


changes  in  responding  unlike,  or  more 
1 that  characterised  Che  steady-state 
two  middle  panels  (sessions  9 and  1)  Che 
noticeably  denser  toward  the  end 
td  to  carry  thorough  to  the  nett 
IS  a tendency  for  longer  IRTS  to 

I transition — there  was  little 


Thus,  for  this  pigeon,  there  was  little  indication  that  the 
changes  wichin-sessions  were  nearly  sc  large  as  those 
between  sessions. 


For  Pigeon  5994,  too,  there  was  little  Indication  of 
within  session  changes  that  were  large  enough  to  "explain* 
the  changes  which  occurred  acroas-eeesions.  That  is,  the 

amoh  greater  than  that  which  occurred  within  a sesalon  and 
the  change  that  did  occur  within  a aession  waa  comparable  to 
state  conditione. 


o Btsellna 


Ab  can  be  seen  in  figure  12,  all  3 subjects  displayed  a 

changed  back  to  VI  SO  a,  particularly  within  the  first 

subject.  For  Pigeons  1097  and  5994  the  data  depicted 
from  the  tranBltlon  back  to  VI  which  followed  the  phase 


Pot  Pigeon  1097  th 
1 depicted  in  Figure 


Responses/min 


Responses/mi 


1097 


Malecnlar  DaBcrlntlBn.  Betura  to  toaellna 


beginning  of  the  tranaition  bach  to  VI  (Figeone  5994  and 
2760)  oc  fron  very  near  the  beginning  (Pigeon  1097).  The 


phases  (Figure  2B,  right  panele)  except  for  two  things: 


IRT  Duration  (0.01 


Ordinal  Position 


and  dlaappear  quite  abruptly.  Ales,  like  Pigeon  1097,  the 


aploted  in  Plguz 


Pigura  48.  IRT  duration  as  a function  of  ordinal 
position  in  the  session  tor  soma  selected  sessions 
during  the  transition  depicted  in  Figure  43  for 
Pigeon  1097.  The  ordinal  position  of  the  session 
poat-phasa  change  is  indicated  in  each  panel. 
3L-axeet  ordinal  position  in  the  session:  T-axae: 


IRT  Duration  (0,01  s) 


reflect  changes  within  a session.  The  rate  of  response  in 
the  session  which  preceded  these  two  sessions  (session  10) 
was  at  baseline  levels  as  was  approxlniateiy  the  first  half 
of  Session  11.  After  the  first  half  of  Session  11,  however, 
the  partem  of  responding  became  abruptly  quite  lllce  that 
obaerved  during  the  experimental  phases.  This  pattern 
continued  through  the  entire  next  essslon  (top  right-hend 
panel).  During  the  ll-session  portion  from  which  the  two 
middle  panels  were  selected  the  pattern  of  responding  was 
the  same  as  that  under  steady-state  VI  conditions.  As  the 
bottom  two  panels  show,  however,  responding  was  not  stable 
as  the  pattern  of  responding  ahruptly  shifted  to  one 
resembling  that  under  experimental  conditions. 


only  flii^htly,  during  the  first 
three  pigaona  considered  here.  Figure 


C response  declined 


following  the  change  in  achedule  from  VT  300  s,  RTB-t  e to 
the  VT  schedule. 

Chiring  the  55  aesaiona  in  which  this  phase  was  in 
effect  for  Pigeon  1694,  reaponse  rate  declined  only  about 
30-35%  {note  that  the  y-axie  is  truncated).  The  response 
rate  for  this  pigeon  was  not  allowed  to  become  stable 
beoause  of  the  extreme  slowness  of  the  change.  Response 
rate  did  not  change  much  during  the  first  25  seasions 

lower  than  at  any  time  during  Che  stable  portion  of  the 

rate  declined  in  a fairly  steady,  linear  fashion.  For 
Pigeon  1404  reaponee  rate  was  somewhat  lower  than  during  the 
ecable  portion  of  the  preceding  phase  right  at  Che  beginning 
of  the  VT  phase.  Although  eome  of  these  data  points  were 
barely  outside  of  the  range  of  those  under  the  preceding 
phase,  there  was  a clear  effect;  response  rates  were 
virtually  never  below  160  reaponses/min  for  more  than  I or  2 


Following  imnediaCely 


Responses/min 


184 


Relative  Frequency 


1694 


Relative  frequency  of  different  1 
esalona  during  the  tranaltion  to  VT 


Relative  Frequency 


1404 


FlguE0  52.  Relative  frequency  of  different  IRTS 
selected  deesione  during  the  transition  to  VT  for 
Pigeon  3673.  The  ordinal  position  of  the  asasion 
indicated  in  each  penal,  x-axes:  0.01  s bins;  y- 
reiative  frequency. 


Relative  Frequency 


3673 


0.01 


bins 


fundanantal  rhytha  la  aomawhat  larger  and  there  la  a eloate 
of  IRTS  at  alightly  lesa  than  1.5  a ahowlng,  pethapa,  the 


All  that  can  be  aaid  la  that  nonrhythnic,  long  IRT 
reapondlng  Incraaaed  In  probability  acroaa  aeeelona.  For 


rhythmic 


probability  of  Ions  "nonrhythailc  IRTS."  For  thla  pigeon  the 


poBLtlon  In  the  deoelon  for  selected  seeaiona  during 

position  of  the  aession  is  indicated  in  each  panel. 
X-arest  ordinal  position  in  the  aeBsion;  T-anest  IRT 


IRT  Duration  (0.01 


1694 


Ordinal  Position 


position  in  the  session  for  selected  sessions  during 
the  trsnsition  to  VT  for  Pigeon  14Q4.  The  ordinal 
position  of  the  session  is  indicated  in  each  panel. 
X-axBS)  ordinal  position  in  the  session;  Y-axsei  IRT 


IRT  Duration  (0.01 


1404 


I ">r  9 


Ordinal  Position 


figure  S5.  IRT  duration  as  a function  of  ordinal 

the  transition  to  VT  for  Pigeon  3673.  The  ordinal 
position  of  the  session  is  indicated  in  each  panel. 
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chythnic 


hl9h  as  they  were  at  ' 


rapid.  For  Pigeon  Ii 


espondlng  was  virtually 


Responses/min 


DBanlnstul. 

For  Pigeon  1SS«,  the  :rt  flistributlon  did  not  ehenge 


had  Increased  in  prohahillty  accompanied  by  a slight 


Relative  Frequency 


1694 


ri^uxe  56.  Relativo  fraquenoy  of  diffexent  IRi 
the  flxat  BSBsion  duxinq  the  txassitlon  to  the 
in  which  raaponaes  added  tine  to  the  currently 
acheduled  interval  for  Pigeon  1404.  R-aria:  0. 
binei  y-axiat  relative  frequency. 


Relative  Frequency 


1404 


0.01  s bins 


position  in  the  session  for  selscte<i  sessions  during 

tljBe  to  the  currently  scheduled  interval  fox  Pigeon 
1694.  The  ordinal  position  of  the  eesaion  is  indicated 
in  each  panel.  X-axes:  ordinal  position  in  seesion; 


IRT  Duration  (0.01 


1694 


8 m 4 


Ordinal  Position 


position  in  the  eeesion  for  the  first  eession  during 

tijae  to  the  currently  scheduled  interval  for  Pigeon 
14Q4.  X-axiS3  ordinal  position  in  session;  Y-axlai 


1404 


1st  session 


Ordinal  Position 


and  nonrhythnic 


Qygrall  ra»pena>  tatai  return  to  VT 


ja 


Figure  Ovarall  reeponse  rata  ae  a function  of 

aeaslonB  following  the  return  to  VT  for  Pigeons  1694 
and  1404.  X-axea:  seasiona;  Y-axes:  raaponaea  per 


Responses/min 


Relative  Frequency 


1694 


for  selected  aeBsions  during  the  return  to  VT  for 
?igecn  1404.  The  ordinal  poeltion  of  the  session 

Y-axasi  relative  freguency. 
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Fi^re  64.  IRT  duration  as  a function  of  ordinal 
the  return  to  7T  for  Pigeon  1694.  The  ordinal 
position  of  the  Bession  ie  indicated  in  each  panel, 
r-axeai  ordinal  position  In  sesaioni  Y-axee)  IRT 


IRT  Duration  (0.01 


1694 
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Figure  S5.  IRT  duration  as  a function  of  ordinal 
position  In  the  session  for  selected  seaaiona 
during  the  return  to  VT  for  Pigeon  1404.  The 
ordinal  position  of  the  session  Is  indloated  in  each 
panel.  X-aaesi  ordinal  position  In  eeeeion;  ?-axesi 


IRT  Duration  (0.01 


1404 


Ordinal  Position 


MolaculJ^  '<°-'—'pCieni  raturn  to  VT  30CI  «■  BTB-t  « 


For  Pigaoa  1694,  tha  probaJsility  of  long,  nonrhythmic 


rhythn  Increased  only  slightly,  but  Che  modes  began  Co  be 


Figure  6S.  Overall  reaponae  rate  aa  a function 
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3673 


Sessions 


Figure  67.  Relative  frequency  of  different  IRT5 
for  delected  aeBsions  during  the  return  to  VT  300  b, 


RTRe-t  ■ for  Figeon  1694.  The  ordinal  position  of 
0.01  B bine;  Y-axeet  relative  frequency. 
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the'‘flrat  tour  seegions  ^rlng  Che  return  Co  vr  300  e, 
RTE°-t  s for  Figeon  1404.  The  ordinal  poeiclon  of 
0.01  a bine;  y-axee:  relative  frequency. 
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Relative  Frequency 
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Figures  10,  11,  and  IS  show  IHT  duration  as  a function 
of  ordinal  position  in  the  session  for,  respectively. 
Pigeons  1694,  1404,  and  3613.  The  sessions  for  which  data 


position  in  the  session  for  selected  sessions  during 

The  ordinal  position  of  the  session  is  indicated  in 
each  panel,  z-axas:  ordinal  position  in  session; 
¥-axesi  IRT  duration  in  0.01  s units. 
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during  the  return  to  VT  300  b,  RTB--t  e for  Plgaoo 
1404.  The  ordinal  position  of  the  session  is 
indicated  in  each  panel,  x-axesi  ordinal  position 
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Fi^r«  72.  IRT  duration  ae  a function  of  ordinal 
poaitlon  in  the  aasalon  for  the  third  through  eighth 

Pigeon  3673.  The  ordinal  position  of  the  session  is 
indicat^  in  each  panel.  Z'axeat  ordinal  position  in 


IRT  Duration  (0.01 


3673 


Ordinal  Position 


ror  PlgBoa 


increase  In  prohahillty  of  long,  nonrhytluiic  IRTS  throughout 


Chaneee  In  the  Character  of  Transltlone 


Pigeons  109?  and  5994.  These  tvo  pigeons  showed  changes  In 
the  character  of  transitions  to  experlioental  phases  and\or 


Figure  73.  Overall  response  r 
aesBlone  during  transitions  fsoo  baseline  "early* 


Responses/min 


achadula  (VI  3000  a,  BI6-4S  a)  produced  on 
incraaaaa  in  rate  of  raaponaa  during  aarly  aaaalona, 


parciGulerly  Important  aa  it  ahowa  tha  diatribution  which 


Relative  Frequency 


n 1097 

ILdI 


Stabla-Stataa 


CHAFTBR  4 
DISCUSSION 
Overall  Rajpnnae  Ratesi 

dlagoaal  oiovement  through  the  schedule  space  was  associated 
with  Incresaes  in  rate  of  response  (Bee  Figures  14  and  32). 
This  finding  Is  in  general  agreenent  with  other  studies 
Investigating  interlocking  schedules,  especially  Powers' 
(1968)  and  Rider's  (1977).  The  present  studies,  thus, 
extend  the  generality  of  this  finding  to  pigeon  subjects  and 
to  interlocking  schedules  where  the  base-intacval  or  tijne- 

Experinents  1 and  2 do  not,  however,  provide  an  exact 
specification  of  the  shape  of  the  surfaces  which  result  when 
rate  of  response  (or  maximum  rate  of  response)  is  plotted  as 
a function  of  2 or  3 of  the  parameters,  or  the  form  of  the 
aquations  which  describes  then.  There  are,  however,  enough 
data  to  make  speouiation  fruitful. 

For  this  discussion  only  coanipulation  of  RTB  and  BI 

than,  sero  will  be  considered.  The  two,  3-dimensional, 
surfaces  fomed  when  rate  of  response  (or  maximum  cate]  is 
plotted  as  a function  of  RTB  and  BI  with  a*Q  or  with  a-w 
appear  quite  similar  or,  at  least,  the  data  collected  ao  far 


aubBtantially 


relevant  to  both  of  than. 

The  data  collected  so  far  uaing  echedulee  from  these 
apacee  aaggest  three  faaturee  of  importance.  Pleat,  aome 

Small  diagonal  mevamanta  avay  from  RTE«Q  (RTE  decreaaea  and 
BI  inereaeea}  can  reault  in  little  change  in  reaponaa  rate. 
Decreasing  RTB  while  holding  BI  constant,  too,  nay  not 
produce  inoraaeee  at  eome  levels,  rhle  is  particularly 

can  be  unambigucuely  interpreted)  in  Berryman  and  Nevin 
(196J). 

if  reeponee.  This 
inter loching-schedule 


Secondly, 

can  produce  large 

data  presented  so  I 

through  the  epacea 

feature  ia,  again, 
schedule  data.  It  is  evident  whi 
different  interlocking  echedulee 

schedules  were  imposed. 

Theee  three  facts  suggest  that  rate  of  response, 
BI  is  held  constant,  ie  an  a-ahaped  function  of  -1(61 


and  81  increasing)  no 
response  ratee  under 


point,  and  haa  the  dimenalona  1/timej  it  night  be  viewed  aa 


Thfl  a^ve  aquation — whan  conbined  with  a tranafozaiation 
of  the  VI  ‘input-output*  function  (i.e.,  rata  of  ceaponaa  aa 
a function  of  the  rata  of  reinforceiDant  under  VI  achedulaa) 
in  tame  of  interval  value  inetead  of  rate  of 
relnforceraent — can  be  used  to  deacribe  the  data  from  the 

tranafomation  of  the  VT  "input-output"  function  (l.a-,  the 
function  relating  responae  rate  to  VT  parameter)  oould  be 
used  to  describe  data  from  the  related  apace  where  aaO.  The 
rate  of  reaponse  at  RTb-O  is  simply  given  by  the  tranafomed 
•input-output"  function  and  thia  amount  ia,  aaeentially, 
added  to  the  amount  given  by  the  above  equation.  That  ia* 
reap.  rate-(  vi-K)+(hk) /(N*(»-N)e>'""ij 

where  VI  is  the  rate  of  responae  under  a given  value  of  BI 
and  RTE«0.  In  a complete  treatment,  both  N and  R might  be 
expected  to  be,  themselvee,  funotiona  of  BI,  For  example, 
the  flat  portion  around  RTE-0  probably  gets  broader  as  BI  la 
increased  because  the  eame  RTE  value  would  constitute  a 
amaller  proportion  of  the  interval.  The  function  might  alao 
be  expected  to  rise  more  slowly  st  higher  BI  values  for  the 

Figure  7S  shows  5 cross-sections  perpendicular  to  the 


crosa-eection  and  rate  of  responae  is  plotted  as  a function 
of  -RTE.  Bach  croBs-seotion  has  a different  "growth 
parameter")  R gets  smaller  as  large  BI  values  are 
approached.  K was  held  constant  for  simplicity  but  this  is 


Figure  75.  Rypotheticel  curves  i 

and  BI.  Snail  BI  values  appear  J 
large  BI  values  in  "far"  panels. 


function  of  RTB 
’near'  panels  and 


Responses/Tim 


small  BI 


-RTE  (units  time) 


Specifically,  » and  R misht;  bi 


show  bistability  and  hystarsais. 


show  bistability  and  hysteresla  (Nicholas  & Prigogina, 


Responses/Time 


-RTE  (units  time) 


responaa  rate 
autaoatalytlc 


different,  shorter  IRTS  vill  be 
will  increase.  This  produces  a 


PS  are  reinforced,  etc,  i.e.,  an 
>cess.  Prom  a molar  perspective. 
Introduction,  rate  of  response  1 
interval  schedule  is  changed  to  a ratio  schedule 
it  allows  Increases  in  rate  of  response  to  produce 
reinforcement  which  in  turn  results 
higher  rate  of  reaponse  and  so  forth,  i.e.,  another 
of  autocatalyaia . 

In  addition  to  the  largely  conceptual  reasons  given. 


suggeeted,  for  example,  • 

function  (Baum,  1993).  &s  the  rai 

ratio  values  are  reached,  however, 
abruptly  drop  to  zero.  Such  a altuation  resembles  that  . 
the  top  curve  In  Figure  7S.  If,  in  fact,  rate  of  respom 
fell  absolutely  to  tero,  however,  increasing  the  absolute 
value  of  RTE  (by  decreasing  it  from  aero)  would  not  be 
expected  to  result  In  the  lower  curve  in  Figure  7S.  Thli 
because  there  would  be  no  way  for  the  change  In 
contingenclea  to  -contaef  behavior.  This  consideration 
alone  auggests  that  the  first  "model"  suggested  would  noi 

responding.  This  Is  because  there  Is  not  a provision  th! 


function  that  relates  rata 
inverse,  but  discontinuous 
itio  value  increaaea  there 


ounta  for  blatabiuty  and  hyatBiBala.  tMb  finding 


r (1986)  ara  plott 


Responses/Sessio 


schedule 


e of  response  decreases  (Bsun,  19P3] . 
Thus,  at  small  ratio  and  interval  schedules,  neither 
oonceptlon  will  likely  hold.  The  conceptions  a 

rates  of  response.  Ac  this  point,  the  theories  say  nothing 
about  the  issue  of  'deviations  from  a steady-state' 
(Skinner,  1938). 

All  six  pigeons  whose  data  are  reported  here  showed 
apparently  chronic,  nonrandom,  but  nonperiodic  oscillation 
in  rate  of  response  which  was,  in  general,  most  apparent 
under  Interlocking  and  ratio  schedules.  Although  Skinner 
(1938)  dieouesed  the  issue  of  stable  oseillations  at  some 
length  it  has,  with  a few  notable  exceptions,  been  all  but 
ignored.  This  is  surprising  because  wherever  the  iasue  has 
bean  addressed  such  oscillations  have  been  noted  (Ciinming  a 
Sehoenfald,  19S0;  Palya,  1992;  skinner,  1938;  8ellar  a 
Davis,  1978).  Skinner  (1936)  and  Sailer  and  Davis  (1978) 
dlaoussed  oscillations  in  FI  schedules,  cumralng  and 
Schoenfeld  (I960)  dlacussed  than  in  T-tau  schedules  and 
Palya  reported  data  from  VI,  VR,  PI,  PR,  IRT>t  and  IRT<t 
schedules.  Palya  (1992)  p 
which  keypacking  was  ra 
schedule.  These  data,  from  about  sasaion  150  to  780,  showed 
variability  closely  tsaanhling  chat  for  the  pigeons  In  the 
present  Experiments  1 and  3 (See  Palya,  1992;  Figure  !,  4th 
panel  from  the  top  in  the  rightmost  column) . In  addition  to 


e pigeon  f 


extreiMly 


stability 


Dpefully,  only  at  tinea 


sadlngly 


■Ixpoeed'  ts  a phlloaop 


yBteaa  (SlaaB  6 Hackey, 
t neceBsarily  be  taken  t, 


clahUlty 


exparljients  could  taka  years  to  complate>  Although 


deacrlptions  to  emacge.  Palya'a  (1992)  work,  as  well  as 


Seiler  and  Dayis  (1978)  are  important  stepa  In  that 


applied  in  order  to  assess  the  nature  of  any  sequential 
dependencies  or  regular  oeclUations  that  might  exist-  In 


It  will  probably  be  neceasary  to  invaatigate  directly  looe 
of  the  putative  oxtraneoua  variables  freijuently  aald  to 


ople. 


VR  had  been  iaipoaed  again  the  traneitidn  would  have  been 
more  similar  to,  or  even  more  rapid  than,  those  ooeurring 
for  98  and  75».  An  alternative  interpretation  ie  that 
schedules  within  a continuum  which  generate  eguivalent 
atable^states  will  produce  equivalent  transltiona.  In  that 
case  the  differencee  obeerved  in  the  present  experiment 
represent  the  range  of  variation  in  the  rate  of  change.  A 
first  step  in  investigating  these  alternatives  would  be  to 
perform  experiments  involving  repeated  transltione  between 
the  same  schedules,  for  example,  VI  60  e to  matched  VR 
schedules.  Such  experiments  would  reveal  the  nature  of 
changes  across  successive  transitions,  as  well  as  the  range 
of  variation  that  could  be  expected  whan  a steady-  or 
stable-state  of  transitions  la  produced.  Such  an  experiment 
could  be  seen  as  important  to  inveatigatlone  of  the  rate  of 
change  in  response  rate  as  a function  of  schedule 
parameters;  It  seems  lUcely  that  once  a steady-  or  stable- 
state  of  transltione  has  been  produced  with  one  set  of 
experimental  parameters  there  would  be  little  systematic 
trend  if  another  schedule  parameter  vae  used.  This 
proposition  could,  of  couree,  be  directly  investigated  by 
following,  for  example,  repeated  transitions  between  VI  and 
VR  with  repeated  transitions  tetween  the  sams  VI  schedule 
and  an  Intarlocking  schedule. 

Molecular  Data!  stahle-gtsres 
A Striking  feature  of  the  molecular  data  ie  the 
prevalence  of  IRTS  at  approximately  0.3  s and  Integral 


ThlB  type  at  rhythnlc  responding  probably  represents  a 


geone  typically  eat 


Bspecially 


showed  a great  deal  o£  responding  at  the  0.3-s  rhytho  under 


rhythm. 


and  J?  [Exparlnent  1)  and  in  Figure  37  (Experiment  2(. 

There  have  been  few  etudiea  of  the  aystematic  change  (or 
lack  thereof)  in  IRT  duration  acrosa  interreinforcenent 
periods  in  variable-interval  end  variable-ratio  schedules 
with  which  these  data  nay  be  compared.  Kintsch  (1965), 
however,  using  2 cats  as  subjects,  compared  VI  40  a and 
VR  15.  Under  VI,  Kintsch  (1955)  found  no  statistically 
significant  change  in  IRTs  across  the  first  30  responses 
(this  was  all  ha  analysed),  although  both  rats  did  show  a 

essentially  inconsistent  with  the  data  presented  for 
Experiment  1,  although  Pigeon  1097  did  show  a downward  trend 
in  average  IRT  for  the  first  10-15  responses.  It  is 

of  Che  present  experiment  since  Kintsch  (1965)  presented 
averages  of  14  sessions,  and  these  14  sessions  followed  only 

had  been  previously  exposed  to  the  VR  15  sohedule.  Under 
VR,  Kintsch  (1965)  found  t)iat  average  IRT  duration  decreased 
for  the  first  4-5  responses  for  both  rata.  Following  this 
decrease  average  IRT  increased  for  1 rat  and  remained 
unchanged  for  Che  other.  These  data  are,  thus,  somewhat 
more  consistent  with  the  findings  for  Experiments  1 and  2 
with  regards  to  interlocking/ratio  conditions. 

Palya  (1992)  also  presented  data  relevant  to  changes  in 
his  data  are  difficult  to  compare  with  t)ie 


over  the  first  few  seconds,  follcjwed  by  a slight  (a  few 


th0  D06t  complex  changes  vere  exhibited  by  Pigeon  1097  under 


of  the  0-3-8  rhythm.  The 


tPlgure  30), 


Pigeon  5994  under  VR  {Figure  29,  right  column)  there  wee  a 


and  3673  (Figui 


obablllty  of  longer  i 
ole  rhythm.  In  £jcpez 


IRT/OP 


cut  0.3  e tanded  to  ba  the  higheet  in  the  ibt/OP  funetl 
d the  IRT  distribution.  Per  Pigeon  2760  the  IRT/OP 

6 IRT/OP  functions  for  Pigeons  1694  and  3673  under  VT 


present  atudlaa,  and  it  la  difficult  to  find  any  IRT/OP 


the  two  pigeons  that  ahswed  a peak  in  the  IRT/OP  function  at 


replotted 


{Rhlep'a  'dunp  bln"  waa 


rhythmic  raaponding  tendai 


nonrhythaiic  reepondin 


patterning  liie  that  during  VI  vould  suddenly  intrude.  For 
the  most  part,  the  reaponse  patterning  during  these  early 
sesBlona  was  like  that  during  interloek/ratio  schedules  (for 
Pigeon  2760  Che  transition  in  question  occurred  following 
the  condition  in  which  BTE  was  an  inverse  function  of 
responding)  except  for  the  sudden  intrusion  of  vi-like 
response  patterning.  Pigeon  1404  (Experiment  2), 
surprisingly,  briefly  displayed  responding  at  the  0 . 3 to 
0.4-s  rhythm  during  the  return  to  VT  (after  teepondlng  was 
eliminated  during  the  condition  in  which  responses  added 
time  to  Che  currently  scheduled  interval).  This  was 
surprising  since  this  pigeon  had  shown  llttls  or  no 
responding  of  this  type  under  any  stable  state.  By  the 
sixth  session  following  ths  change  back  to  VT,  the  response 
pattern  was  again  characterized  by  ehort-duratlon  IBTs . 

The  fact  that,  during  ths  return  to  VI  60  a,  pigeons 
1097  and  2760  shoved  brief  Inttusione  of  Vl-llke  responding 
represents,  to  some  extent,  a violation  of  the  general  rule 
that  changes  during  tranaltlons  tend  to  be  greatest  between 
sessions.  During  these  kinds  of  schedule  changes,  rate  of 
reinforcement  changed  immediately  upon  reintroduction  of  the 
VI  60  e schedule,  independent  of  changes  in  rate  of 
reaponae.  Perhaps  dramatic  wlthln-seesion  changes  occur 
only  when  rate  of  reinforcement  is  reduced  immediately  upon 

the  VT  21.1-B  schedule 


a change  in  schedules 
from  Pigeon  3673  In  Experiment 


B«ant.lally  Indistinguishable  from  responding  originally 


arly  in  the  experiment.  Pigeon 


appUeabla  and  tha  general  way  in  which  tha  ayat 
eoncaptuallaBd, 


ths  flxed-intarwal  paranater  (Schama  i Branch,  19B9).  The 
manipulation  of  interlocking  achaflulea,  therefore,  muat 
alnoBt  certainly  repreaent  a powerful  way  syatenaclcally  to 
modulate  drug-effocte,  since  this  repreaenta  a ayatematlc 
manipulation  of  the  interval-ratio  continuum.  Farther,  it 
ia  clear  from  the  InterlooUng-achedula  data  that  behavioral 
states  intermediate  to  those  under  Interval  and  ratio 
achedulea  can  be  maintained.  It  would,  thus,  seem  to  be  of 
interest  to  obtain  doae-effect  curves  under  different 
Bchedule  pararaetera.  The  effects  of  drugs  on  behavioral 
states  Intermediate  to  those  produced  by  ratio  and  interval 
schedules  would  be  of  particular  interest.  It  would  also  be 
of  interest  to  study  ths  effects  of  drugs  on  responding 
maintained  by  different  schedule  paremeters  that  produce, 
nevertheleae,  essentially  idontlcsl  rates  and  patterns  of 
response.  Should  there  be  a difference  In  the  dose-effect 
curves  under  the  different  parameters  they  would  have  to  be 
due  to  variables  that  do  not  differentiate  responding  during 
baseline.  It  would  be  equally  interesting  If  there  wore  no 
differences  in  ths  doee-effect  curves  for  this  would  begin 
to  delimit  the  boundarlee  of  the  schedule-dependent  drug 
effect. 

Thera  are  aavaral  waya  to  Inveatlgate  the  effects  of 
drugs  on  behavior  maintained  by  achedulea  In  the  interval- 
ratio  continuum.  One  set  of  parameter#  might  be  in  affect 
for  a long  period  of  time  and  dose-effect  curves  obtained 
for  each  set  of  parameters  or  several  different  sets  could 


ftin  responding  under 


unlikely  that  the  probe  sesslona 


rentually  yielding  d* 


based  strictly  on  eorralatlon  axe  the  moat  fundamental;  a 
correlation  may  be  arranged  without  aaeuming  temporal 
contiguity,  but  the  reverse  is  not  true.  (Notice  that  It  ie 
not  being  claimed  that,  at  the  controlling  variable  level, 
there  re  no  relationehlp  between  the  arranged  correlation 
and  the  temporal  distance  between  leaponssa  and  relnforoera 
or  that  temporal  distance  per  ae  is  not  ‘really  the 
operative  variable.)  Ae  long  as  operations  are  Important  In 
the  definitions  of  basic  behavioral  processea,  such  aa 
positive  and  negative  ralnforoement,  it  ie  probably  best  to 
keep  correlation  per  se  and  oorrelations  produced  by 


former  iB  the  more  generol  from  the  etandpolnt  of 
experimental  operatlone. 

The  foregoing  diecussion  points  out  why  the  schedule 
apace  offered  here  la  referred  to  as  the  fundamental 
echedule  space;  It  ie  built  up  from  the  general  notion  of 
response-dependency  or  correlation.  The  special  hind  of 
correlation  which  ie  arranged  when  talnforoets  are  made 
necessarily  temporally  contiguous  ie  ‘factored  in‘  by 


arranging  a tandem  requirement  defined  by  the  s psrameter. 

The  operational  eeparation  of  correlation  and 
contiguity  eliminatee  an  aeynmetry  between  positive  and 
negative  reinforcement  procedures  that  has  been  described  as 
neceesary,  Elnellne  (1984),  for  example,  wrote;  ‘There  Is  a 
fundamental  aaymmetry,  [between  poaltlve  and  negative 
reinforcement)  for  if  a stimulus  or  situotion  le  to  be 


teleeularlBB,  Moltrlsn.  Contr. 


aymnetricAl  schedules,  in  the  top  panel^  51  is 

it  la  not.  X-axest  nate  of  responss.  T-axes:  rate 
of  relnforcenent. 


Rate  of  Response 


requires  'hypothetlcel 


typically  rely 


raaponsa  because  Interval  echadules  lead  tb  the  differential 
reinforeement  of  relatively  longer  ZRTs  [Anger/  1956j  Horae, 
1966).  That  ie,  the  probability  that  a reinforcer  has  been 
■set  up"  increaees  ae  a function  of  tine.  The  longer  the 


IRT,  therefore,  the  higher  the  probability 
reinforceaent  haa  been  "set-up. * Under  rat 


primary  nolecular  component 
Skinner,  1957).  Schedules  that  are  i 
BcheduXee  should,  according  to  all  ot 
produce  hlg)iec  rates  of  reeponee  thar 
Rider  (1977),  however,  has  suggested 


I.  Sons  researchers  h 
Bchedules  differentially  ri 

ledulee  (Horae,  1966]  to  explain 
differences  or  is  itself  the 


interpretations , 
L-schedulee. 
molecular  chaoriea 


o their  prsdlctions  concerning 
ratio-  schedules  because  they 


are  soinewhat  ambiguous  a 
interloc)clng  interval-  a 

concede  that  nolecular  analyses  c 

Introduction) . Although,  rates  of  reeponae  i] 
ratio-  and  interval -schedules  were  observed  in  Experiment  1 
(albeit  only  for  Pigeon  5994)  and  in  other  experiments  it  ii 
also  coiBBion  for  acme  interlocking-schedules  to  produce  the 


Molecular  theories,  however,  do  not  themaelves  typically 
specify  potential  rate-llmlcinp  chacaecexistlce  of 


from  xeeponaae.  For  these  two  pigeons  responding  woe 
eliJBinsted  when  rasponses  added  tine  to  the  currantiy 


from  a strictly  sK>lacular  vis».  Fcrthae,  it  is  not  true 
that  all  1ST-  dlJfetentlation  procedures  produce  relatively 
alow  transitions.  For  example,  Kuoh  and  Platt  (1976),  using 


these  occurred  within  20  hours.  This  latter  finding 
corresponds  weli  with  the  data  from  Experiment  1;  two  of  the 
three  subjects  typically  showed  small  increases  In  rate  of 

decreases  obtained  in  Experiment  1 upon  change  from 


Molar  lnt»rpratatlen«  ot  the  Ra«ult« 


decrease  as  ratio  value  increases  (i.e.,  the  derivative  of 
the  aeeociated  feedback  functions  decreases);  a wide  rsn^e 
ef  ratio  schedules  produce  nearly  the  sajiie  high  rate  of 
response.  In  Experinenc  1,  rates  of  response  under  various 
interloc)cing  schedules  tended  to  be  equivalent  snH  equal  to 

functions,  too,  have  been  advanced  to  explain  the  decreases 
in  rate  of  response  produced  by  responae-independent 
reinforcement  on  behavior  previously  maintained  by  reaponae- 
dependent  reinforcement.  Proa  this  perspective,  there  are 
two  ways  that  transitions  from  response-dependent  to 
response-independent  reinforcement  could  produce  decreases 
In  rate  of  xesponsa;  the  slope  of  the  feedbae)c  function  la 
aero  everywhere,  and  the  varienaa  In  the  feedback  data 
{points  in  the  response  rate/relnforcement  rate  apace] 
should  be  greater  under  reaponae-lndependent  schedules  than 
resgwnee-dependent  achadulee,  Tha  range  of  the  feedback 
data  would,  in  any  event,  almoet  certainly  be  greater  in 
response-independent  schedulee. 

Both  of  the  above  Interpretations  are  potentially 
troublesome  for  molerlem.  if  the  difference  between  VT  and 
VI  aohedulea  le  a matter  of  the  slope  of  the  feedback 
function  at  asymptote,  then  one  would  expect  that  slight 
changes  in  the  derivative  at  asymptote  under  other  schedule 
pairs  would  be  a powerful  variable.  It  la  almost  certain, 
however,  that  changing  from  a vi  schedule  to  an  interlocking 
schedule  that  is  very  close  to  a VI  schedule  {i.e.,  RTB  ie 


d Wolaeular  POBltloi'g 


coHoaittdd  proponants.  Experinenta , auch  ae  Expariaient  2, 


n behavior  despite  the  fact 
nt  renalns  roughly  constant 


over  the  entire  course  of  the  experiment  (Galbiclca,  KautSf  k 
Jagere,  1993j  Kuch  k Platt,  1976).  These  experiments 
typically  arrange  reinfoccenent  based  on  characteristics  of 
an  organietQ’s  recently  emitted  behavior,  and  contingencies, 
therefore,  change  as  behavior  changes.  It  Is  this  aspect  of 
such  experiments  which  allows  rate  of  reinforcement  to 
remain  constant  (in  much  the  same  way  as  pressure  nay  be 

in  temperature,  by  allowing  volume  to  vary).  It  Is  lUcely, 
however,  that  such  experiments  can  be  described  in  terms  of 
"tenporally- local  feedback  functions"  and  their  rslatlonship 
to  responding.  If,  for  example,  only  the  longest  IRTS  of  an 
organism's  temporally- local  diatribotion  of  irts  are  elated 
for  reinforcement,  then  higher  than  average  rates  of 
responding  will  result  In  a locally  low  rate  of 
reinforcement,  whereas  a local  low  rate  of  responding  will 
result  in  a locally  high  rate  of  reinforcement. 

Koleculariata  have,  perhaps,  been  guilty  of  setting  up 

has  been  pointed  out,  molecularlsts ' argumente  agalnet 

de  clear — much  of  the  molarista’ 
e derivative  of  the  feedback  function. 

quantitative  predictions  of  performance  during  transitions 


directly  observable.  OnlUce  strength,  however,  probability 


identifying  a higher  rate  of  response  with  a higher 


probaJ^llities  vhich  may,  nonethelaso,  be  expreBaad  In  terne 


ultimately. 


saponee  may  lower  the  probability  of  reaponding  and  each 


abability. 


CHAPTER  S 
CONCLUSIONS 


temporally 


a of  controlling  v 


axplalned 


and  interlocking 


Interlocking  interval-ratio 
achadules.  For  the  most  part,  »T*  waa  either  negative 
(leaponaea  aubtractad  tine  off  of  the  acheduled  interval)  or 
tero  (responaea  did  not  affect  the  scheduled  interval).  The 
achedulea  investigated  In  both  experiments  fell  roughly 
along  a line  oriented  diagonally  through  the  croaa-eection; 
that  la,  larger  ST  values  were  aaaoclated  Mith  analler  (more 
negative)  RTB  values.  Pigeons  in  experiment  1 
{a — >lnfinity)  were  always  exposed  to  the  original  baseline 
VI  BO  a schedule  (filafO,  STE*0)  following  each  axpoeure  to 
other  schedules.  In  Experiment  2 (s«0)  pigeons  ware  exposed 

increaeingly  lees  dependent  on  responding,  and  then  exposed 
to  the  same  schedules  in  reverse  order. 

The  goal  of  the  experiments  reported  here  was,  sii^ly, 
to  characterize  responding  maintained  by  schedules  in  the 
space  in  detail.  In  addition  to  overall  rate  of  response 

of  responding  was  analysed  in  terms  of  irt  distributions, 
IRTS/OP,  delays  between  responses  and  food  (Experiment  2) 


In  both  experiments,  the  maximum  rate  of  reeponae  flrat 
increased  rapidly  as  BJ  wee  increased  and  RTE  waa  decreased. 
After  a certain  point,  however,  rate  of  reaponee  no  longer 

studies  of  Interlocking  schedules,  suggest  that  response 
rate  la  some  monotonically  increasing,  s-ahaped  function 


plots 


in  Experlnent  1 responded  at  the  typical  rhythm,  there  were 


were  not  part  ol  the  tundanental  rhythm  or  its  harmonics. 
Poe  niaet  of  the  pigeons,  "nisBes,"  and  the  ocaurrence  of 
long  IRTS,  gre»  slightly  more  probable  as  a function  of 
ordinal  position,  measured  from  the  occurrence  of  food. 

Transitions  between  different  aohedulas  within  the 
space  were  frequently  rapid.  During  some  schedule  changes, 
rate  of  reinforceoant  was  held  constant  at  the  time  of 


t is,  parameter  valuee  ware  chosen  such  that, 
if  rata  of  response  did  not  change,  rate  of  ralnforoement 

BQoetlmea  changed  rather  slowly  across  sessions.  In 
contrast,  schedule  changes  that  involved  an  Inmedlata  change 
in  rate  of  reinforcement  were  always  relatively  rapid. 

During  schedule  changes  where  rate  of  reinforcement  did  not 
change  until  rate  of  response  changed,  there  wae  little 
change  In  rate  ol  response  within  a session.  This  was  true 
even  if  the  overall  responae  rate  was  changing  quite  rapidly 
across  sessions,  When,  in  Experiment  I,  however,  the 
schedule  was  changed  back  to  the  baseline  Interval  schedule 
(which  involved  an  immediate  decrease  in  rate  of 
reinforcement]  there  were  substantial  changes  in  the 
temporal  atruotnre  of  reaponding  within  a aesslon.  Dnder 
these  circumstances,  the  structure  of  responding  suddenly 
shifted  to  that  appropriate  to  the  baseline  Interval 
schedule.  The  duration  of  such  shifts  grew  longer  aoroes 
seesione  until  the  structure  of  reaponding  remained  similar 
to  that  seen  under  the  previous  Interval  baseline. 


Although  BxperijnentB 


positive  zeinforcement,  ' 
portion  of 

postponeisent  are  arranged  whan  RTE>0.  The  important  aspect 
of  these  particular  avoidance  echedules  is  that  the/  can  be 
convenientl/  compared  Co  schedules  of  positive  reinforcement 
that  arrange  correlationa  between  responding  and  events  that 
are  equal  in  absolute  value  (but  opposite  in  sign)  to  those 

possible  Co  arrange  schedules  of  positive  and  negative 
reinforcement  that  are  identical,  eacept  in  terns  of  the 
direction  of  the  correlation  between  responding  and  events. 
Such  schedules,  it  was  argued,  should  prove  invaluable  in 
comparing  the  effects  of  positive  versus  negative 
relnforcenent,  espsclally  in  terms  of  the  impact  of 
pharmacological  variables. 

discussed  in  relation  to  a mathematical  treatment  of 
schedule-controlled  behavior  in  tame  of  continuous 
differential  eguations.  it  was  argued  that  rasponae  rate 
may  be  conceptualised  as  a maaeure  of  the  probability  of 

s variable.  It  was  pointed  out  that, 
f probability  night  be  dispensed  with 

lOh  a treatment  would  seen  to 
e spatial  locus  of  the  organiem  or  Ite 
Finally,  it  was  pointed  out  that 


involve  describing  t 
parts  through  t 
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